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ABSTRACT 

This is an individually administered test designed 
to evaluate programs that teach English as a second language, 
specifically the Southwestern Cooperative Educational Laboratory's 
(SWCEL) Oral Language Program for children in the primary grades. A 
major goal of the test is to elicit responses in as "spontaneous" a 
manner as possible in order to arrive at a reasonably realistic 
assessment of a child's speech. Test materials consist of an 
administrator's manual and a kit of props which provide stimuli for 
the desired, tape recorded, children's responses. No special skills 
are required to administer the test. Classroom teachers, familiar 
with the directions, stimuli, desired responses, and use of the props 
can administer the test in about 10-15 minutes, While pronunciation 
and vocabulary items are included, major emphasis is upon grammatical 
competence. Scoring is done at the SWCEL from the taped conversation. 
A total score and two part scores (VocabuLary and 
Pronunciation--items 3-26, and Use of English Grammatical 
Structures-- items 27-83) may be obtained. The test is not 
standardized; however, field testing of the instrument has provided 
general categories of scores which permit classification of groups of 
students in terms of English fluency and data on reliability and 
validity. (RF) 
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INTRODUCTION 

This test was designed to provide a means of 
evaluating programs that teach English as a second 
language, specifically the Southwestern Cooperative 
Educational Laboratory's Oral Language Program for 
children In the primary grades. It Is suitable for 
both pre-testing and post-testing. A major goal of 
the test is to elicit responses In as "spontaneous" 
a manner as possible In order to arrive at a reason- 
ably realistic assessment of a child's speech. 

There are major difficulties here, --especially In 
the elicitation of questions and relatively complex 
constructions In the context of a rather carefully 
structured verbal Interchange. 




The test is administered with the aid of a series 
of props that provide stimuli for the desired responses. 
These responses may range from single words to com- 
plete sentences. While pronunciation and vocabulary 
Items are included, the major emphasis is on gramma- 
tical competence, that Is, how well the child is able 
to produce well-formed responses of varying degrees 
of complexity. 
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TO THE ADMINISTRATOR 

Test materials consist of an administrator's 
manual and a kit of props. Other necessary items are 
a tape recorder and tapes, a table where you and the 
child can be alone. 

Proper test conditions are necessary for success- 
ful administration and optimum results. Examine the 
test and run a number of trials before attempting to 
administer it. Once you are familiar with the dir- 
ections, stimuli, desired responses and use of props, 
the test can be given with ease in about 10-15 minutes. 

Since the test probably will be given in a school, 
you should have advance contact with the building 
principal and the teachers involved. DIjcuss the 
testing conditions and stress that you will be working 
with children individually, that the test is tape re- 
corded, and that you need a quiet room where you can 
talk with each child alone. A quiet setting Is impor- 
tant in order to record the child's voice clearly and 
with a minimum of background noise. 
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You can keep the atmosphere relaxed if you know 
the test well and establish rapport with the child. 

It is suggested that you talk briefly with the child 

l 

before beginning. This could be done while bringing 

» I 

him from the classroom. The test should be intro- 
duced as a game with pictures and objects for him 
to see and talk about. Since a room other than the 
classroom is used, it Is important to explain your 
purpose to the child before taking him from the 
classroom. Arrange the table and chairs so that they 
are comfortable for the child and convenient for you. 

It is suggested that you sit beside the child rather 
than across the table from him. 

The child should be reinforced with a variety 1 of 
responses during the test. Select your responses care- 
fully and Individualise them. Some children respond 
well to direct verbal praise, others become reticent 
at this and do better with more casual praise such' as 
a nod or a smile. Some children enjoy being touched 
while they are verbally rewarded. Spoken responses 
you might use are "very good, ""thank you,” "okay," 
and "that's right." 

s » ; 
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Give the child ample time to answer the stimulus, 
but keep the pace moving so that the conversation is 
directed to the test. The amount of time necessary to 

respond will differ among children. If a child becomes 

» * 

restless, he can be given a brief break. Please turn — 
the t,ape recorder off during any breaks. 

BASIC ADMINISTRATION INSTRUCTIONS 

The test is organized into five types of activities. 
In the first activity, the child is given a box of items 
to identify. In the second activity, the animals from 
the box are used to elicit responses such as preposi- 
tlonal phrases. The third activity is aided by the 

l 

use of two marbles in a smdll box. The fourth activity 
Introduces a book with pictures of Mary and Tony in 
various settings. In the fifth activity, no props 

I 

are used and emphasis is on things that the child and 
administrator are doing. 

Each item usually begins with ad .nistrator ' s 
directions which are in italics. In capital letters, 
indented and below the directions, are the adminis- 
trator’s verbal directions to the child. Further 
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indented to the right and set in quotes are the de- 
sired responses. For clarity, some directions are 
interspersed with the administrator's verbal stimulus. 
When this is done they are put in parentheses as well 

as Italics and are written as briefly as possible. 

» 

Further directions are sometimes given at the end 
of an item. An underlined word Indicates that 
another word of the same class is acceptable. 

The administrator's verbal directions to the child 
may be repeated if necessary; however, any directions 
should be repeated only once . If repeating is 
1 necessary, try to repeat only the words most necessary 
to achieve the response.. Repeating might be needed 
especially when the desired response is a question. 

The first two items serve as an introduction 
and a name check. In items 3-26, the child may 
be prompted if he does not give the desired vocab- 
ulary word. Try to get him to say the word first 
by using a prompt such asi "What else is it called?" 

In this way, the child will still score a vocabulary 
point if he says the word before the administrator does. 
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If ho still does not give the desired response, 
use the prompt M say cup" (or whatever is wanted) 
in order to see if he can handle the pronunciation. 

Prompt the child on items 27-83 if he gives an 

/ 

incomplete or minimal type response. Prompting 
is not used if an ungrammatical response or 
no response is given. The only prompt used is 
"tell me (the desired response)" or "ask me 
(the desired response)", depending on the structure 
wanted. Any prompt should only be used once 
for an item. The score is lower if prompting is 
necessary. Prompts should be stated in a form 
that requires the child to change some of the 
words for answering whenever possible. 

Example: Item 39- 

Say-" GIVE ME THE DOG." (Child should 
give you the animal he has.) 

WHAT DID YOU DO? 

Desired Response -"I gave you the dog." 
Child's Response-" the dog " 

Prompi-"TELL ME THAT YOU GAVE ME THE DOG . " 
Child's Prompted Response-" I gave you the 

dog . " 
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In all cases a child nay use either 
contractions or the long form of words. 

The teaching sequence is used between items 
26 and 27. A special tape is inserted into the 
recorder at this point for Mary's voice. This 
sequence is added to help the child understand 
what is desired of him in his verbal responses. 

Included in each test kit is a cloth pad 
which should be used to cover the table surface, 
in front of you and the child. This will help to 
absorb any noises made by the props. 

SCORING 

Scoring of the test is done at SWCEL from 
the taped conversation and is marked on a 1230 
machine scoring sheet. Responses are diagnosed 
.by trained scorers and the child may range from 
minimum to maximum points for items. Scoring 
instruments consist of a scoring key, a listing 
of p o s s i"b le responses, and the machine scoring 
sheet. 
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The child scores one point for responding 

4 

to items 1 and 2. 

Items 3-26 are scored for vocabulary and 
pronunciation of sounds. One point is given 
in the vocabulary section for each item the 
child knows. If the child does not identify 
the item and the tester Jvas" to say it for him 
to repeat, a point can still be alloted for 
each sound the child uses which is being tested. 

Items 27-83 measure a child's ability 
to use English grammatical structures. The 
chart on page 9 indicates what each item 
measures, what is necessary for maximum or 
minimum score credit, and the Oral Language 
Program lesson in which the English structures 
are first taught. A child may range from 1-3 
points for items 27-83. These items are scored 
and the type of response is graded as to its 
completeness and it's spontaneity. 
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It is felt that the more spontaneous and 
complex a response, the higher the score should 
be. Different types of responses are scored in 
separate columns. The four categories of 
responses for items 27-»83.are: 1. A three point | , 1 

score is allocated when a spontaneous and complete 
response is given without prompting. 2. Two j 

points are scored for minimal response given 



l > 



without prompting. 3. Two points are scored for 

a complete response given with prompting. 

1 ’ !i 

4. One point is given for a minimal response that'i 



I 



was produced only after prompting. 



A child's total test score is the sum of all 

ir 



of the above mentioned scores. 

To allow for further evaluation, a supple- 
mentary scoring section is used. This gives one 
point for each grammatically correct English 
structure that a child uses which differs from 
the English structure being tested. 
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Three types of evaluation may be made from 
the scores. One is in assessing relative 
strengths and weaknesses of an individual or — 
class by noting individual part scores. A 
second evaluation may be gained by comparing 
various student's scores within the same 
school or class. Third, growth scores may be 
obtained by comparing pre-test and post-test 
scores. This may be done for individuals 
and classes. 
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RELIABILITY 



Reliability has been established by the 
"split-half" method, and by test-retest 
method . 

The reliability obtained by the split- 
halves method is the reliability of half the 
test rather than the whole test. Correction 
by the Spearman-Brown prophecy formula of 
the split-halves correlation has given a 
reliability of >92. Seventy-one pupil records | 
were analyzed. -i 

The test-retest reliability was j 

established with 10 pupils. There was one ! 

week duration between pre-test and post-test. j 

Reliability was established with a correlation ! 
of .91. I 

I 

VALIDITY i 

Validity of items was first established I 

by factor analysis of items . Only meaningful i 
factors were included in the test items. ' 
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A further check on validity was estab- 
lished by correlation of the SWCEL revised 
oral language test with the Michael Test of 
Oral English Production. Correlation on the 
total test score for 22 people was .7^- 
Eleven subjects received the revised test 
second. There was a one week delay between 
the tvfo tests. 
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w 

« 

Eh 

CO 

M 

CO 

H 

w 

EH 

Q 

M 

EH 

<sC 

fr. 

W 

a3 

Eh 

CO 



to 

H 

W 

Eh 



$1 

fc 



o 

p 

o 

»d 

p 

o 

p 

c 

o 

p 

'd 

d 

d 

H 

U 

♦H 

tO 

o 

p 

o 

p 



w 

w 

Eh 

CO 



CO 

H 

W 

tH 

a 

•j 

M 

o 

w 

w 

Eh 

to 



CO 

M 

w 

EH 



81 

CQ 

* 



d 

o 

to 

d 

> 

o 

p 



c- 

<0 

M 

W 

Eh 

CO 

Eh 

W 



& 

fc 



>> 


a 


s 


O 


>> 


d 


o 




o 


CO 


CO 


0. 


CO 


0. 


to 




* • 

VO 

04 



01 

04 



H 

H 

«3 

P 

O 

P 

P 

c 

►rl 

o 

P« 



CO 

H 

w 

Eh 

CO 

EH 

< 

W 



tj 



fc 



S 

CO 



M 

04 



04 



l/\ 

04 


















p 




















d 






i 














•H 






1 














o 






1 














IX, 








































c^* 




















o 




















& 




















H 




















o 




















p 




















M 






j 














td 




















to 




















to 




















hi 




















Eh 






i 


« 












< 


* 


















w 


t-i 


* 




o 












Sr 


IP 




l 


rO 




w 










d 


* 


\ 






• 










*Q 






O 
















* 




"P 




M 








p 












d 








d 


r — i * 




P 




♦o 








•rf 


fci o 


\ 


a 


p 






C-* 




O 


* 




•H 


p 


d 




w 




cx 


.♦$? P. 




o 


< 






> 




s— ' 




mmi t 






« 


C3 




< 


• 














d 




w 


IP 




dj 


* 


j 




< 


d 






5P 


• 








• 




►d 




w 


d 




*ri 


■* 




&> 


M 






w 




o 








u 


> 


P 




to 




o 


t-i 


■* 


1 


0 


< 








d 


c 


d 




) 


P 


W 


£ 




to 




* 




* 




o 




O 




w 


CO 










•H 


w 


O 




o 


d 


to 


d 


* 




Vi 


w 


o 




p 


*SJ 


M 


V 










*d 








w 








s 


to 




• 


H 


<d 




o 






M 


fc 1 


<d 


H 


< 




o 








•H 


o 






w 


<0 




00 




r 


R 


p 




*H 




fc 


M 


fc 




] 








U> 






p 






| 














p 






i 








o 






D 








p* 






P 






fX 








0 


s 






s 










J 




0 




P 


d 




to 






i 


TJ 


CO 




d 


to 




hH 








rH 


, 




*H 














o 






o 






w 














0# 






w 








• 






• 






• 






i 








CO 






Os 








<\J 






OJ 






C\4 







VO 

C\J 




Put the pig, cow, and dog and sheep on the table in front of 
the child. 
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35- Say PUT YOUR HAND HERE. (Help cbild put his hand 

over the pie . ) 
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Say YES, I DO. (open your hand) AND HERE IS ANOTHER ONE 
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WHOSE HAND IS THIS? (Point to child's). 
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